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Research into learning technology has developed a reputation for being driven 
by rhetoric about the revolutionary nahire of new developments, for paying 
scant attention to theories that might be used to frame and inform research, and 
for producing shallow analyses that do little to inform the practice of education. 
Although there is theoretically-informed research in learning technology, this is 
in the minority, and has been actively marginalised by calls for applied design 
work. This limits opportunities to advance knowledge in the field. Using three 
examples, alternative ways to engage with theory are identified. The paper con¬ 
cludes by calling for greater engagement with theory, and the development of a 
scholarship of learning technology, in order to enrich practice within the field 
and demonstrate its relevance to other fields of work. 
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Introduction 

This paper poses the question: why should we be concerned with theory? To 
answer this, a review is provided of the ways in which theory has - and has not - 
been engaged with in learning technology research. This is followed by three cases, 
in which different ways of engaging with theory are offered. The paper concludes 
by identifying ways in which work in this field frequently fails to engage with the¬ 
ory, and how this situation could change, creating a more dynamic relationship 
between theory and practice. 


Background: theory and pragmatics in learning technology research 

Theory has had a relatively small role to play in learning technology research to 
date. Mostly, research has focused on matters of practical implementation and 
design, largely driven by ‘common-sense’ assumptions about what technology can 
achieve, or - for many decades - by hype and excitement rather than evidence or 
theory (Mayes 1995). For example, reviews (for example, Conole, Smith, and 
White 2007) have shown that visible, tangible investment - typically purchase of 
hardware or software — has been the priority for funding over a 45-year period, not 
educational principles. Only later, if at all, has work followed that addresses the 
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patchy and inconsistent patterns of use that typically follow such investment. Such 
reviews make it clear that fashion and markets (Selwyn 2007), rather than principles 
or theory, remain the major driving forces behind much research, development and 
implementation work in this area: 

Research has a tendency to follow policy directives and technological developments, 
rather than informing them [...] sadly there has been too much evidence of knee-jerk 
policy, which does not take account of evidence arising from research. (Conole, Smith, 
and White 2007, 53) 

This gap is not only visible in relation to policy. According to Friesen (2009), 
research in this field generally treats theory and empirical work as separate, rather 
than as integral parts of the same endeavour. Friesen offers a useful conceptual 
framework for this discussion, identifying three different traditions of research. 
Drawing on Flabermas, he distinguishes between instrumental (concerned with tech¬ 
nical interests associated with work or production), practical (concerned with inter¬ 
pretation or meaning) and emancipatory traditions. Fie goes on to argue that only 
the instrumental is well represented in this field, and that the conspicuous absence 
of theory is an important indication of this: 

To use the words of educational technologist Rob Koper [...] this research tends 
not to be ‘theory-oriented,’ but rather ‘technology-oriented’ in character. E-leaming 
research, Koper (2007) explains, is not focused on “predicting or understanding 
events [in] the world as it exists” (p. 356); it instead seeks to "change the world 
as it exists” (p. 356; emphasis added). E-leaming or technology-oriented research, 
in other words, attempts “to develop new technological knowledge, methods, and 
artifacts” for practical ends or purposes (p. 356). It is this applied, practical, and 
technological research that Koper (2007) says is ideally suited to e-leaming. 
(Friesen 2009, 7) 

Another indication of this pragmatic orientation can be found in Conole and 
Oliver’s (2007) introduction to the field. They identify four groups of issues within 
learning technology research: pedagogic, technical, organisational and socio¬ 
cultural. Arguably, using Friesen’s categories, the first three of these could be 
classified as instrumental, and even the fourth could be viewed as a means to instru¬ 
mental ends. Theory or even critique remains conspicuously absent. 

This current situation reflects a long-term preoccupation with practical prob¬ 
lems. Flawkridge’s historical account of the development of educational technol¬ 
ogy as a field (2002) illustrates this. The review draws together previous reviews, 
meta-studies and content analyses, grouped by continental tradition and stretching 
back to work in the late 1960s. He describes how a North American tradition 
grew from instructional design, which was founded on objectivism and linked to 
industrial and military uses of systems analysis. As this grew through the 1960s 
and 1970s, it established connections to broader educational work focused on the 
curriculum and on the science of teaching. The result of these links was the 
development of programmed instruction: a pragmatically oriented technique for 
enhancing learning outcomes using behaviourist principles. A consistent emphasis 
throughout this period was on the scientific improvement of the practice of teach¬ 
ing, largely through automation. (A fuller account of this is offered by Saettler 
1990.) Research in other English-speaking countries was strongly influenced by 
the North American tradition, drawing heavily on US texts. Systems-based 
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approaches were also well represented in the United Kingdom; for example, in 
the work of Pask (for example, 1976). Although the role of theory has broadened 
since this early period, Hawkridge argues that the primary focus of learning tech¬ 
nology research into this century has been pragmatic, concentrating on applica¬ 
tions of new technologies and the pursuit of behavioural evidence of improved 
learning outcomes. 

In spite of the growing popularity of qualitative studies of constructivist inspired 
learning environments since the early 2000s, which could have offered other models 
of research, this emphasis on practical applications persists and indeed has been 
periodically reinforced by commentary such as that of Reeves: 

To realize the fullest potential for online learning, our methods of research and 
development must be fundamentally changed, but additional changes are needed. 
First, we must shift from a position that views learning theory as something that 
stands apart from and above instructional practice to one that recognizes that learn¬ 
ing theory is collaboratively shaped by educational researchers and practitioners in 
context. Educational technology is a design field, and thus, our paramount goal of 
research should be solving teaching, learning, and performance problems, and 
deriving design principles that can inform future decisions. Our goal should not be 
to develop esoteric theoretical knowledge that we expect practitioners to apply. 
This has not worked since the dawn of educational technology, and it won’t work 
in the future. (2005, 304) 

This continued focus on practical ‘use-inspired’ design research is promoted as 
‘socially responsible’ (Reeves, Herrington, and Oliver 2005), to be valued above 
and pursued in preference to other forms of research. This view, advocating the type 
of learning technology research that should be done, limits possibilities for advanc¬ 
ing the field. While design research works well for investigating the effectiveness 
of a particular design in practice, and so helps to infonn instructional design theory, 
it has little relevance to non-design problems. Even the emergence of design 
research as a methodology - one with a “focus on advancing theory grounded in 
naturalistic contexts” (Barab and Squire 2004, 5) - has done little to change this, 
since its focus continues to be on “developing a profile or theory that characterizes 
the design in practice” (2004, 4), rather than on wider concerns. Reigeluth and 
Frick’s (1999) distinction between instructional design theory and descriptive theo¬ 
ries of learning is helpful here, drawing attention to the scope (and hence the limita¬ 
tions) of a design research focus. Seeing learning technology research as primarily 
- or even exclusively - occupied with developing and testing designs misrepresents 
the breadth of work actually being undertaken (Czemiewicz 2010). 

To illustrate these wider concerns, Thorpe’s review (2002) is helpful, since it is 
focused directly on theory and pedagogy. She describes how, over the previous dec¬ 
ade, pedagogic thinking shifted from a focus on materials and instruction to social 
competence, collaboration and situated performance, mirrored by a shift in the theo¬ 
ries used to justify the work from behaviourism to social constructivism. This 
account can be understood as raising some modest challenges to Friesen’s critique, 
suggesting that practical and emancipatory research have in fact called instrumental 
‘progress’ into question - albeit only for a few restricted areas of work - by sug¬ 
gesting that some changes may not always be seen as improvements. So, for exam¬ 
ple, Thorpe describes how accounts (many of which are related to positions such as 
constructivism) that celebrate increased student independence and autonomy can be 
critiqued as excuses for leaving students isolated and unsupported. This is not the 
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kind of challenge that can be answered with more empirical data; instead it needs, 
we suggest, a position to be taken about what is desirable and why. In other words, 
it needs theorising. 

This account illustrates how research in the field can focus on questions other 
than design. As Czemiewicz’s review (2010) demonstrates, while instructional 
design is sometimes positioned as the ‘core’ of work in learning technology, the 
field is really too diverse and fragmented for such a claim to be credible. She points 
instead to evidence that theory is brought in through links to numerous other fields, 
and development “takes the fonn of new languages which offer fresh perspectives 
and a new set of connections, rather than integration with existing theories and 
approaches” (Czemiewicz 2010, 524). Treating theory as if it was simply and solely 
a foundation for applied design fails to represent the richness of work that can, and 
sometimes is, undertaken within this field. It leaves theory unchallenged - and often 
unquestioned - so that empirical work supports or illustrates theory, but is not seen 
to develop or even provide a basis for rejecting it (Cook 2002). Such work is possi¬ 
ble, however, as the cases in the next section will demonstrate. 


Case studies of engagement with theory 

As argued above, much work in the field of learning technology either neglects the¬ 
ory or else operates in a derivative way, simply applying it. However, there are 
examples of kinds of work that show different forms of engagement with theory. 
Three examples are given here, showing how empirical work can develop theory; 
how theories and evidence can undermine claims and redefine design problems; and 
how theory can change the way that a phenomenon is understood. 


Case one: mutually informing theory and practice 

Richard Mayer’s body of work on multimedia learning exemplifies a particular 
branch of learning technology research based on the kinds of psychological theories 
and approaches that have been popular since the early years of research into com¬ 
puter-based or computer-assisted learning. Over his career Mayer has produced an 
extensive body of work that has drawn on traditional scientifically based experimen¬ 
tal methods to advance understanding about how interactive multimedia influences 
learning. Many well-recognised principles of multimedia design stem from Mayer’s 
findings. 

Mayer’s research illustrates how empirical work can define, rather than apply, 
theory. It builds on the desire “to understand how people integrate verbal and visual 
infonnation” (Mayer 1997, 4) as the basis for improving multimedia design; some¬ 
thing that requires a twin focus on theory and practice. Mayer, describing his theo¬ 
retical approach (1997), explains how this work built on previously established 
theories of cognitive processes, which he applied to the new environment of multi- 
media. The literature contains a series of more than 40 studies that are informed by 
previous results and incrementally develop refinements and extensions to that theo¬ 
retical approach (for example, Mayer and Chandler 2001; Mayer and Johnson 2008; 
Mayer and Moreno 2003). While, at one level, this work fits within the traditional 
of learning technology research as informing the design of instructional software, it 
does this in a dialogic way. Theory does not simply inform design; Mayer’s 
findings do generate design principles, but they also reshape the underlying theory. 
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It would be easy to dismiss Mayer’s work as ‘out of step’ with current thinking 
in learning technology research. For example, research into content-driven, direct 
instruction of the type with which Mayer was concerned has been replaced by a 
focus on constructivist approaches. Moreover, critics have labelled experimental 
methods in learning technology research misguided (Clark 1983) and pseudo¬ 
scientific (Reeves 1993), arguing that learning is too complex to allow for the 
proper isolation of variables required by the scientific method. It is also claimed that 
experimental studies are conducted in environments so artificial that their findings 
have little relevance to real classrooms, and that researchers must over-reach in 
making claims about the wider applicability of their findings. Such criticisms have 
been important in establishing qualitative research as a viable and valuable 
approach; however, it ignores the status of Mayer’s design recommendations: they 
are provisional and tentative, rather than being nomothetic laws, created to guide 
design rather than prescribe it. Problems that arise when using them in complex 
classrooms should therefore be fed back into the theory, allowing it to be refined, 
rather than being seen as evidence of its failure. 

Mayer’s work thus has something important to offer a discussion of the role of 
theory in learning technology research. Mayer has achieved a coherent, inter¬ 
connected body of work that is informed in every way by the theory in which it is 
located, from its conception (building directly from unanswered questions raised by 
past research and under-developed theory), to execution (the methodologies used), 
and to interpretation (what it means in relation to the questions asked, earlier find¬ 
ings and future research). This work is narrow in its focus, and appropriately mod¬ 
est in its claims, limited to studies and applications of how people understand 
verbal and visual information in combination. However, Mayer’s work demonstrates 
the kind of two-way conversation in which the empirical speaks to theory too, 
developing it. This kind of dialogue between empirical studies and theory is largely 
absent from learning technology research, according to the reviews provided above. 
Through this reciprocity, Mayer’s theory seeks to explain phenomena, and observa¬ 
tion of phenomena is used to test and develop theory. Through theory his studies 
connect to a wider body of related research on cognitive processes in computer- 
based learning. In sum, Mayer’s work demonstrates how theory can inspire, frame 
and guide research that cumulatively builds knowledge in a highly focused area. 


Case two: reframing design problems 

Games and virtual worlds have become a popular topic within learning technology 
research, and much has been written about their educational potential (for example, 
McFarlane, Sparrowhawk, and Heald 2002). It is claimed, for example, that digital 
games have developed powerful and effective pedagogies that education would ben¬ 
efit from adopting (Gee 2005). In other words, games have developed design princi¬ 
ples that could usefully be applied in educational contexts. 

However, there are two problems with this. The first can be revealed by using 
other theories to re-interpret the situation. For example, cultural theory suggests that 
it may be wrong to think of this as a design problem at all. This conception of the 
situation rests on an assumption that may simply be inappropriate: that education is 
failing students and that games are “a kind of remedy [... so that] the diseased, 
geriatric body of education can be treated through the rejuvenating, botox-like effect 
of educational game play” (Pelletier 2009). If this kind of ‘treatment’ account fails 
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to hold - for example, because forced play is an oxymoron, and so requiring stu¬ 
dents to use games cannot credibly be seen as meaningful play - then the whole 
endeavour is misconceived. 

Secondly, such ‘hopes’ are often perpetuated by claims about games’ potential. 
These claims are based on popular perception rather than theory or evidence arising 
from specific examples of play (Squire 2002). 

In order to rethink the relationship between games and learning, and avoid the 
tendency to discuss both games and learning in the abstract, a situated approach 
was developed to studying what people learned when they played digital games. 
Activity theory was used as the basis for this, since this allowed recorded perfor¬ 
mances to be characterised and analysed as purposeful, goal-oriented activities 
(Oliver and Pelletier 2006). The alternative - ‘common-sense’ accounts of ‘poten¬ 
tial’ - was simply too vague to be studied and judged with any hope of credibility. 

The theory of expansive learning (Engestrom et al. 1996) positions learning as a 
creative, situated process in which social practices are adapted to cope with chal¬ 
lenges or problems. Building on this, evidence of learning during play was gener¬ 
ated by identifying breakdowns, such as failed attempts to progress through a level, 
and then looking to see whether there was evidence that this problem had been 
overcome. Where it had, the new approach to play was given a descriptive label 
and added to the expanded list of strategies used by the player. This resulted in spe¬ 
cific, situated strategies (e.g. “spot unusual objects and click on them”) and three 
broader categories that were positioned as different kinds of learning: learning to 
use tools skilfully, learning about objects and spaces within the game, and learning 
the tactics and strategies needed to progress through the game (e.g. how to identify 
and respond to ‘set piece’ encounters, even when these differed representationally). 
Subsequent work with a more complex game (Oliver and Pelletier 2005; Pelletier 
and Oliver 2006) provided evidence about transfer of strategies from previous play, 
but also about inappropriate transfer and of forgetting successful strategies. This 
meticulous building and categorisation of lists provided a credible and transparent 
evidence base for the claims that were made. Unlike earlier claims, these were 
empirically grounded and culturally specific; they showed how learning happened 
when playing digital games, but also showed how situated it was. This helped to 
explain why games could not simply be ‘injected’ into curricula (de Freitas and Oli¬ 
ver 2006). 

Moreover, these studies did not simply apply theory to infonn design. Conven¬ 
tionally, analyses using activity theory operate at the level of case studies, character¬ 
ising the practices of a bounded group of actors over period of time, as (for 
example) in Engestrom’s Change Laboratories (Engestrom et al. 1996). In the cases 
referred to here, however, the focus is on individuals playing games for a period of 
hours — a relatively ‘micro’ focus, in which the influence of community (e.g. 
designers, other players) is either absent or mediated by the software and hardware. 
The result of this is a focus on evidence of learning through changed behaviour - 
something more akin to Skinner’s Behaviorism than to conventional socio-cultural 
accounts of learning. While Oliver and Pelletier’s work (2005, 2006) is case-study 
based, it uses this evidence to challenge widely-made claims; linking these to an 
established tradition of work by not only applying an existing approach in a new 
field, but also exploring, in a modest way, how the scope and utility of that 
approach could be developed. In this sense, it also provided an opportunity for dia- 
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logue with the foundational tradition of work in which the theory had originally 
been developed. 


Case three: theory to frame research within a wider context 
Chen’s (2010) PhD study into Chinese international students’ experiences of online 
learning was prompted by a desire to frame a study of technology within a wider 
context. The research could have been conducted as a descriptive case study of the 
specific experiences of these learners of this type of online delivery, but theory 
allowed it to be conceptualised as a ‘case’ of something more general: a case of 
acculturation. This kind of refraining allows a study of technology use - something 
apparently only of interest within the field of educational technology - to be reposi¬ 
tioned as relevant to an entirely new audience. 

Current learning technology research includes many in-depth case studies of 
how a technology has been applied to education. Findings from these cases studies 
often consist of detailed descriptions, sometimes concluding with a list of emerging 
themes or issues. These have obvious practical value: when presented appropriately, 
such research supports the kind of “naturalistic generalizations” that Stake (1995) 
suggests can happen when readers compare a case study with their own experiences 
and draw conclusions. 

However, there is usually little attempt made in the analysis of such case studies 
to draw conclusions of the kind suggested by Yin (2009, 43) that can “generalize a 
particular set of results to some broader theory”. This is because this type of case- 
study research is driven by an interest in investigating a practical problem (e.g. how 
to use blogs in higher education); a pragmatic focus that often has little connection 
with theory. As a consequence, particular cases have no way to ‘speak’ to a wider 
body of research. They remain bound to the particularities of the case context. This 
final example demonstrates how theory can allow a case study to be positioned as 
part of a wider body of work, as well as bringing coherence to the study itself. 

In this case, the use of Berry’s (1997, 2005) model of acculturation as an organ¬ 
ising framework led Chen to explore what Chinese students ‘brought’ in terms of 
their assumptions about and past experiences of education in China (their heritage 
culture) to their experiences of Australian higher education (their host culture), as 
enacted in the online learning environments they found themselves in (contact 
between cultures). This illustrates the use of theory to structure the study; theory 
provided an orienting framework to shape data collection and analysis by providing 
a lens that determines which aspects of the context should be attended to and why 
they are important to understanding the phenomenon. Seen through Berry’s model, 
the study focused on collecting data that could characterise the two cultures and the 
outcomes of their contact. In this way, the theoretical lens shaped the research 
design, and in so doing focused the researcher’s attention on particular aspects of 
the context. As part of her analysis, Chen compared her results with the theory’s 
predictions to determine how well the theory explained the outcomes of students - 
an example of Yin’s idea (2009) about how the empirical can ‘speak’ back to 
theory. 

Chen further extended her analysis to draw on theoretical constructs from 
Bernstein (1977) and Maton (2006). The empirical work thus became a site in 
which previously unconnected theories were brought together; and by doing so 
demonstrated how theories from psychology and sociology can work in tandem to 
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conceptualise different aspects of a phenomenon and overcome limitations in each. 
Furthermore, each construct came from a broader theory, although Chen drew on 
only what was needed and useful for the scope of her study. 

This study thus demonstrates three things. The first is the value of theory in 
specifying and advancing understanding of a particular phenomenon. The second is 
the way that this individual study can be connect to broader concerns (in this exam¬ 
ple, acculturation of overseas students, how clashes in educational cultures occur, 
how different fonns of knowledge and knowing are valued), not just remain of 
interest to those concerned with the specific context in which the study took place. 
Thirdly, it emphasises the partial nature of theories: rather than merely applying one 
and expecting data to conform to it, theories were judged for their explanatory 
potential and combined or extended as necessary. Chen (2010) demonstrates how 
this is possible within the scope of a PhD, showing how the integration of theory is 
achievable and valuable even within a single study. 


Discussion 

As the initial review showed, the use of theory in the field of learning technology 
has, primarily, been about its application to solve practical problems. Where dia¬ 
logues between studies and theory have occurred, these are mostly in the context of 
design - again, an instrumental end focused on pragmatics. 

There is nothing wrong with pragmatic research - however, the examples pro¬ 
vided here show that more is possible. Research in the field need not be defined by 
policy, technological developments or popular discourse. It is not always applied; 
and it is not always design oriented. 

The examples here echo and develop the points made in Czemiewicz’s (2010) 
review of research in the field. Research can draw on theories from psychology, 
sociology, cognitive science and education. More importantly, however, these exam¬ 
ples show that theory is useful for more than just improving applied design practice. 
Instead, it has a role to play in creating a coherent, bounded scope for the work; 
thinking through what would count as credible evidence; managing and interpreting 
data; rethinking whether the problem has been framed correctly in the first place; 
situating the study in relation to wider concerns and issues, such as work outside 
the immediate field; and developing the theories themselves. 

The examples have also highlighted that not all theory is ready to apply; some 
requires working through, adapting or selecting from in order to make it relevant 
and practical. As all three of the examples above show, use of theory requires tak¬ 
ing a position: it requires judgement about which parts are useful, which are unnec¬ 
essary, and which need development. In other words, the use of theory requires 
engagement, not just application. There are useful parallels to be drawn here with 
at least three of Boyer’s categories of scholarship (1997): discovery; integration; 
and application. (The case for teaching is arguably less direct.) A scholarly 
approach to research in learning technology should build knowledge, including new 
theories; integrate work from different disciplines in a thoughtful way; and apply it 
to practical problems and concerns. 

Calls to restrict research in the field to applied, design-based, problem-solving 
studies, in which theory is applied rather than challenged or developed, limit the 
kinds of work that are valued. As Czemiewicz (2010) identifies, such calls are ideo¬ 
logical: they legitimate particular research agendas at the expense of others. As 
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Friesen argues (2009), this misses out on other kinds of work that may also be 
important: work that asks whether we are tackling the right kind of problem in the 
first place, or who stands to benefit from these developments, for example. 

However, this does not mean that practical research is undesirable, or that all 
work should be theoretical. To suggest that all research in the field should engage 
with theory is just as ideological as proposing that it should not. Rather, as Freisen 
(2009) and Czemiewicz (2010) both suggest, the field may be better served by val¬ 
uing different kinds of work, and developing our capacity to engage with theoretical 
as well as pragmatic issues. Work that is instrumental is useful, and has its place. 
So too, however, does work that is interpretive, critical or emancipatory, and these 
under-represented alternatives need valuing and encouraging so as to counterbalance 
the increasingly dominant position of theory-free or theory-applying work. 


Conclusions 

Research in learning technology has focused on practical, instrumental concerns, to 
the detriment of its ability to engage with theory. Previous reviews have show that 
theory has been relatively neglected, with most of those examples that do use the¬ 
ory best characterised as applying it rather than engaging with it in a critical or 
scholarly way. This situation risks turning the field into a narrow and derivative 
area of work: at best, only able to draw from other areas; and at worst, only of rele¬ 
vance to those with a vested interest in the specific practical situation currently 
under study. 

This has resulted in many missed opportunities to ‘speak back’ to theory. Learn¬ 
ing technology, as a field, is about more than developing better instructional design 
processes, and this diversity needs to be recognised and valued. We need to be able 
to develop theory, question it and even reject it if necessary; we also need to 
develop the capacity to question whether work in the field serves particular interests 
rather than others, and whether this is appropriate. Learning technology research 
could also be used to make connections with other fields. This could be achieved 
through the integration of theories drawn from other areas; it could also involve 
serious engagement with and development of the ideas and approaches that are 
used. Such engagement would demonstrate the relevance of learning technology 
research to education, psychology and other social sciences, as well as enriching 
our understanding of the problems that we face. 
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